ci: Add python unit test workflows #954

fangyinc · 2023-12-19T12:32:29Z

Here is the result of this workflow on my repository.

fangyinc · 2023-12-19T12:34:20Z

There are still some problems in windows environment testing, and these unit tests will be fixed in the future.

fangyinc · 2023-12-19T12:48:30Z

I suggest that in the short term after this PR been merged, all PRs need to pass unit tests in macos and linux environments to pass. In the future, after the problems in the windows environment are fixed, all PRs need to pass all unit tests to pass.

csunny · 2023-12-19T12:48:49Z

Meanwhile， we have a datasource module, which relies on a third-party database and should not pass CI in single testing.
such as

"""
    Run unit test with command: pytest dbgpt/datasource/rdbms/tests/test_conn_starrocks.py
    
    docker run -p 9030:9030 -p 8030:8030 -p 8040:8040 -itd --name quickstart starrocks/allin1-ubuntu
    
    mysql -P 9030 -h 127.0.0.1 -u root --prompt="StarRocks > "
    Welcome to the MySQL monitor.  Commands end with ; or \g.
    Your MySQL connection id is 184
    Server version: 5.1.0 3.1.5-5d8438a

    Copyright (c) 2000, 2023, Oracle and/or its affiliates.

    Oracle is a registered trademark of Oracle Corporation and/or its
    affiliates. Other names may be trademarks of their respective
    owners.

    Type 'help;' or '\h' for help. Type '\c' to clear the current input statement.

    > create database test;
"""

import pytest
from dbgpt.datasource.rdbms.conn_starrocks import StarRocksConnect

@pytest.fixture
def db():
    conn = StarRocksConnect.from_uri_db("localhost", 9030, "root", "", "test")
    yield conn

These tests will migrate to path tests/intetration_tests/

csunny · 2023-12-19T12:50:20Z

I suggest that in the short term after this PR been merged, all test PRs need to pass unit tests in macos and linux environments to pass. In the future, after the problems in the windows environment are fixed, all PRs need to pass all unit tests to pass.

Very much agree with that.

csunny

r+

csunny

r+

Aries-ckt

r+

fangyinc · 2023-12-19T16:01:12Z

@csunny @Aries-ckt Please review, maybe we can use codecov to automatically add test report information to PR comment in the future.

ci: Temporarily remove the windows environment

Aries-ckt

r+

Aries-ckt

r+

csunny

r+

author penghou.ho <penghou.ho@techronex.com> 1701341533 +0800 committer penghou.ho <penghou.ho@techronex.com> 1707199703 +0800 parent 3f70da4 author penghou.ho <penghou.ho@techronex.com> 1701341533 +0800 committer penghou.ho <penghou.ho@techronex.com> 1707198697 +0800 parent 3f70da4 author penghou.ho <penghou.ho@techronex.com> 1701341533 +0800 committer penghou.ho <penghou.ho@techronex.com> 1707198521 +0800 Add requirements.txt Create only necesasary tables Remove reference info in chat completion result Set disable_alembic_upgrade to True Comment _initialize_awel Comment mount_static_files Fix torch.has_mps deprecated Add API key Comment unused API endpoints Install rocksdict to enable DiskCacheStorage Fix the chat_knowledge missing in chat_mode Update requirements.txt Re-enable awel and add api key check for simple_rag_example DAG Merge main bdf9442 Disable disable_alembic_upgrade Compile bitsandbytes from source and enable verbose Tune the prompt of chat knowledge to only refer to context Add the web static files and uncomment previous unused APIs Add back routers Enable KNOWLEDGE_CHAT_SHOW_RELATIONS Display relation based on CFG.KNOWLEDGE_CHAT_SHOW_RELATIONS Stop reference add to last_output if KNOWLEDGE_CHAT_SHOW_RELATIONS is false Fix always no reference Improve chinese prompts Update requirements.txt Improve prompt Improve prompt Fix prompt variable name Use openhermes-2.5-mistral-7b.Q4_K_M.gguf 1. Fix the delete issue of LlamaCppModel 2. Disable verbose log 3. Update diskcache 4. Remove conda-pack Update chinese prompt and process the model response Extract result from varying tags Add back missing content_matches and put tags regex into variable Update english prompt and decide CANNOT_ANSWER based on language configuration Add 3 new models entries and upgrade bitsandbytes Add few chat templates Update model conversation with fastchat code Revert "Update model conversation with fastchat code" This reverts commit a5dc4b5. Revert "Add few chat templates" This reverts commit e6b6c99. Add OpenHermes-2.5-Mistral-7B chat template Fix missing messages and offset in chat template Update fschat Remove model adapter debugging logs and added conversation template Update chinese chat knowledge prompt Avoid to save the long chat history messages Update chinese chat knowledge prompt Temporary workaround to make the GGUF file use different chat template Use ADD_COLON_SINGLE instead of FALCON_CHAT for separator style Allow no model_name in chat completion request Use starling-lm-7b-alpha.Q5_K_M.gguf Add empty string as system for openchat_3.5 chat template Undo response regex in generate_streaming refactor: Refactor storage and new serve template (eosphoros-ai#947) feat(core): Add API authentication for serve template (eosphoros-ai#950) ci: Add python unit test workflows (eosphoros-ai#954) feat(model): Support Mixtral-8x7B (eosphoros-ai#959) feat(core): Support multi round conversation operator (eosphoros-ai#986) chore(build): Fix typo and new pre-commit config (eosphoros-ai#987) feat(model): Support SOLAR-10.7B-Instruct-v1.0 (eosphoros-ai#1001) refactor: RAG Refactor (eosphoros-ai#985) Co-authored-by: Aralhi <xiaoping0501@gmail.com> Co-authored-by: csunny <cfqsunny@163.com> Upgrade english prompt for chat knowledge

github-actions bot added the internal DB-GPT internal flag(chore|ci|refactor|test) label Dec 19, 2023

csunny previously approved these changes Dec 19, 2023

View reviewed changes

fangyinc dismissed csunny’s stale review via 7ef9eaf December 19, 2023 12:58

fangyinc requested a review from csunny December 19, 2023 13:00

csunny previously approved these changes Dec 19, 2023

View reviewed changes

fangyinc dismissed csunny’s stale review via 3f85d4e December 19, 2023 13:38

Aries-ckt previously approved these changes Dec 19, 2023

View reviewed changes

fangyinc dismissed Aries-ckt’s stale review via ad5b68b December 19, 2023 15:50

fangyinc requested review from Aries-ckt and csunny December 19, 2023 15:58

ci: Add python unit test workflows

4a66985

ci: Temporarily remove the windows environment

fangyinc force-pushed the sdk-dev branch from 71f8c16 to 4a66985 Compare December 19, 2023 16:36

fangyinc mentioned this pull request Dec 19, 2023

docs: add dbgpt_hub usage documents #955

Merged

Aries-ckt approved these changes Dec 20, 2023

View reviewed changes

csunny approved these changes Dec 20, 2023

View reviewed changes

csunny merged commit ba8fa87 into eosphoros-ai:main Dec 20, 2023
4 checks passed

vshy108 pushed a commit to vshy108/DB-GPT that referenced this pull request Jan 18, 2024

ci: Add python unit test workflows (eosphoros-ai#954)

5b4e1cd

Hopshine pushed a commit to Hopshine/DB-GPT that referenced this pull request Sep 10, 2024

ci: Add python unit test workflows (eosphoros-ai#954)

589ac4c

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

ci: Add python unit test workflows #954

ci: Add python unit test workflows #954

fangyinc commented Dec 19, 2023

fangyinc commented Dec 19, 2023

fangyinc commented Dec 19, 2023 •

edited

Loading

csunny commented Dec 19, 2023

csunny commented Dec 19, 2023

csunny left a comment

csunny left a comment

Aries-ckt left a comment

fangyinc commented Dec 19, 2023

Aries-ckt left a comment

Aries-ckt left a comment

csunny left a comment

ci: Add python unit test workflows #954

ci: Add python unit test workflows #954

Conversation

fangyinc commented Dec 19, 2023

fangyinc commented Dec 19, 2023

fangyinc commented Dec 19, 2023 • edited Loading

csunny commented Dec 19, 2023

csunny commented Dec 19, 2023

csunny left a comment

Choose a reason for hiding this comment

csunny left a comment

Choose a reason for hiding this comment

Aries-ckt left a comment

Choose a reason for hiding this comment

fangyinc commented Dec 19, 2023

Aries-ckt left a comment

Choose a reason for hiding this comment

Aries-ckt left a comment

Choose a reason for hiding this comment

csunny left a comment

Choose a reason for hiding this comment

fangyinc commented Dec 19, 2023 •

edited

Loading